Controlling information capacity of binary neural network
نویسندگان
چکیده
منابع مشابه
Storage Capacity of a Multilayer Neural Network with Binary Weights
Statistical mechanics is applied to estimate the maximal capacity per weight (a3 of a two-layer feed-forward network with binary weights, functioning as a parity machine of the hidden units. For K 2 2 hidden units, the maximal theoretical capacity is achieved, a, = 1, and the average overlap between different solutions is zero. These results agree with the simulations. At finite temperature one...
متن کاملDeep Neural Network Capacity
In recent years, deep neural network exhibits its powerful superiority on information discrimination in many computer vision applications. However, the capacity of deep neural network architecture is still a mystery to the researchers. Intuitively, larger capacity of neural network can always deposit more information to improve the discrimination ability of the model. But, the learnable paramet...
متن کاملscour modeling piles of kambuzia industrial city bridge using hec-ras and artificial neural network
today, scouring is one of the important topics in the river and coastal engineering so that the most destruction in the bridges is occurred due to this phenomenon. whereas the bridges are assumed as the most important connecting structures in the communications roads in the country and their importance is doubled while floodwater, thus exact design and maintenance thereof is very crucial. f...
Information capacity of binary weights associative memories
We study the amount of information stored in the xed points of random instances of two binary weights associative memory models: the Willshaw Model (WM) and the Inverted Neural Network (INN). For these models, we show divergences between the information capacity (IC) as deened by Abu-Mostafa and Jacques, and information calculated from the standard notion of storage capacity by Palm and Grossma...
متن کاملResBinNet: Residual Binary Neural Network
Recent efforts on training light-weight binary neural networks offer promising execution/memory efficiency. This paper introduces ResBinNet, which is a composition of two interlinked methodologies aiming to address the slow convergence speed and limited accuracy of binary convolutional neural networks. The first method, called residual binarization, learns a multi-level binary representation fo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition Letters
سال: 2020
ISSN: 0167-8655
DOI: 10.1016/j.patrec.2020.07.033